Skip to content

Fixing CI failures#12789

Merged
sureshanaparti merged 2 commits intoapache:4.22from
shapeblue:fix-ci-failures
Mar 13, 2026
Merged

Fixing CI failures#12789
sureshanaparti merged 2 commits intoapache:4.22from
shapeblue:fix-ci-failures

Conversation

@vishesh92
Copy link
Member

@vishesh92 vishesh92 commented Mar 11, 2026

Description

This PR fixes CI failures

Types of changes

  • Breaking change (fix or feature that would cause existing functionality to change)
  • New feature (non-breaking change which adds functionality)
  • Bug fix (non-breaking change which fixes an issue)
  • Enhancement (improves an existing feature and functionality)
  • Cleanup (Code refactoring and cleanup, that may add test cases)
  • Build/CI
  • Test (unit or integration test code)

Feature/Enhancement Scale or Bug Severity

Feature/Enhancement Scale

  • Major
  • Minor

Bug Severity

  • BLOCKER
  • Critical
  • Major
  • Minor
  • Trivial

Screenshots (if appropriate):

How Has This Been Tested?

How did you try to break this feature and the system with this change?

@codecov
Copy link

codecov bot commented Mar 11, 2026

Codecov Report

❌ Patch coverage is 0% with 6 lines in your changes missing coverage. Please review.
✅ Project coverage is 17.61%. Comparing base (7aa0558) to head (df72d04).
⚠️ Report is 5 commits behind head on 4.22.

Files with missing lines Patch % Lines
...storage/datastore/db/SnapshotDataStoreDaoImpl.java 0.00% 6 Missing ⚠️
Additional details and impacted files
@@            Coverage Diff            @@
##               4.22   #12789   +/-   ##
=========================================
  Coverage     17.61%   17.61%           
- Complexity    15664    15665    +1     
=========================================
  Files          5917     5917           
  Lines        531402   531402           
  Branches      64971    64971           
=========================================
  Hits          93596    93596           
  Misses       427252   427252           
  Partials      10554    10554           
Flag Coverage Δ
uitests 3.70% <ø> (ø)
unittests 18.68% <0.00%> (ø)

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

@sureshanaparti
Copy link
Contributor

@blueorangutan package

@blueorangutan
Copy link

@sureshanaparti a [SL] Jenkins job has been kicked to build packages. It will be bundled with KVM, XenServer and VMware SystemVM templates. I'll keep you posted as I make progress.

@blueorangutan
Copy link

Packaging result [SF]: ✔️ el8 ✔️ el9 ✔️ el10 ✔️ debian ✔️ suse15. SL-JID 17095

@weizhouapache
Copy link
Member

great, only 1 CI failure now

@vishesh92
Copy link
Member Author

great, only 1 CI failure now

Looks it is intermittent. Let me push the fix to make it more reliable.

@boring-cyborg boring-cyborg bot added component:integration-test Python Warning... Python code Ahead! labels Mar 11, 2026
@vishesh92
Copy link
Member Author

@blueorangutan package

@blueorangutan
Copy link

@vishesh92 a [SL] Jenkins job has been kicked to build packages. It will be bundled with KVM, XenServer and VMware SystemVM templates. I'll keep you posted as I make progress.

@blueorangutan
Copy link

Packaging result [SF]: ✔️ el8 ✔️ el9 ✔️ el10 ✔️ debian ✔️ suse15. SL-JID 17100

@weizhouapache
Copy link
Member

@blueorangutan test

@blueorangutan
Copy link

@weizhouapache a [SL] Trillian-Jenkins test job (ol8 mgmt + kvm-ol8) has been kicked to run smoke tests

@DaanHoogland
Copy link
Contributor

@blueorangutan test matrix

@blueorangutan
Copy link

@DaanHoogland a [SL] Trillian-Jenkins matrix job (EL8 mgmt + EL8 KVM, Ubuntu22 mgmt + Ubuntu22 KVM, EL8 mgmt + VMware 7.0u3, EL9 mgmt + XCP-ng 8.2 ) has been kicked to run smoke tests

Copy link
Contributor

@sureshanaparti sureshanaparti left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

clgtm

@blueorangutan
Copy link

[SF] Trillian test result (tid-15610)
Environment: kvm-ol8 (x2), zone: Advanced Networking with Mgmt server ol8
Total time taken: 51304 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr12789-t15610-kvm-ol8.zip
Smoke tests completed. 149 look OK, 0 have errors, 0 did not run
Only failed and skipped tests results shown below:

Test Result Time (s) Test File

Copy link
Member

@weizhouapache weizhouapache left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

great
thanks @vishesh92 @sureshanaparti on the fix

do you know what caused it ?

@vishesh92
Copy link
Member Author

great thanks @vishesh92 @sureshanaparti on the fix

do you know what caused it ?

idStateNeqSearch was changed to idStateNinSearch in the below commit
6fdaf51#diff-105599d1a00be738da925c54fed738536e4d4b190b66947c0ab015d4605c7727R69

But this was reverted while forward merging
d700e2d#diff-105599d1a00be738da925c54fed738536e4d4b190b66947c0ab015d4605c7727R70

@weizhouapache
Copy link
Member

great thanks @vishesh92 @sureshanaparti on the fix
do you know what caused it ?

idStateNeqSearch was changed to idStateNinSearch in the below commit 6fdaf51#diff-105599d1a00be738da925c54fed738536e4d4b190b66947c0ab015d4605c7727R69

But this was reverted while forward merging d700e2d#diff-105599d1a00be738da925c54fed738536e4d4b190b66947c0ab015d4605c7727R70

👍
thanks @vishesh92

@blueorangutan
Copy link

[SF] Trillian test result (tid-15614)
Environment: kvm-ubuntu22 (x2), zone: Advanced Networking with Mgmt server u22
Total time taken: 51042 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr12789-t15614-kvm-ubuntu22.zip
Smoke tests completed. 148 look OK, 1 have errors, 0 did not run
Only failed and skipped tests results shown below:

Test Result Time (s) Test File
test_01_vpn_usage Error 1.09 test_usage.py

@blueorangutan
Copy link

[SF] Trillian test result (tid-15613)
Environment: kvm-ol8 (x2), zone: Advanced Networking with Mgmt server ol8
Total time taken: 55863 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr12789-t15613-kvm-ol8.zip
Smoke tests completed. 149 look OK, 0 have errors, 0 did not run
Only failed and skipped tests results shown below:

Test Result Time (s) Test File

@blueorangutan
Copy link

[SF] Trillian test result (tid-15615)
Environment: vmware-70u3 (x2), zone: Advanced Networking with Mgmt server ol8
Total time taken: 61399 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr12789-t15615-vmware-70u3.zip
Smoke tests completed. 148 look OK, 1 have errors, 0 did not run
Only failed and skipped tests results shown below:

Test Result Time (s) Test File
test_01_vpn_usage Error 1.11 test_usage.py

@blueorangutan
Copy link

[SF] Trillian test result (tid-15616)
Environment: xcpng82 (x2), zone: Advanced Networking with Mgmt server ol9
Total time taken: 71555 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr12789-t15616-xcpng82.zip
Smoke tests completed. 97 look OK, 52 have errors, 0 did not run
Only failed and skipped tests results shown below:

Test Result Time (s) Test File
test_01_events_resource Error 189.84 test_events_resource.py
ContextSuite context=TestLoadBalance>:setup Error 0.00 test_loadbalance.py
test_list_vms_metrics_admin Error 0.12 test_metrics_api.py
test_list_vms_metrics_history Error 0.12 test_metrics_api.py
test_list_vms_metrics_user Error 0.14 test_metrics_api.py
test_list_volumes_metrics_history Error 0.13 test_metrics_api.py
test_nic_secondaryip_add_remove Failure 0.07 test_multipleips_per_nic.py
ContextSuite context=TestIsolatedNetworksPasswdServer>:setup Error 0.00 test_password_server.py
ContextSuite context=TestNestedVirtualization>:setup Error 0.00 test_nested_virtualization.py
ContextSuite context=TestNetworkACL>:setup Error 0.00 test_network_acl.py
test_01_verify_ipv6_network Failure 1.55 test_network_ipv6.py
test_03_network_operations_on_created_vm_of_otheruser Error 1206.12 test_network_permissions.py
test_03_network_operations_on_created_vm_of_otheruser Error 1206.18 test_network_permissions.py
test_04_deploy_vm_for_other_user_and_test_vm_operations Failure 1416.36 test_network_permissions.py
ContextSuite context=TestNetworkPermissions>:teardown Error 1.35 test_network_permissions.py
test_delete_account Error 3.30 test_network.py
test_delete_network_while_vm_on_it Error 1.13 test_network.py
test_deploy_vm_l2network Error 1.12 test_network.py
test_l2network_restart Error 2.27 test_network.py
ContextSuite context=TestPortForwarding>:setup Error 3.49 test_network.py
ContextSuite context=TestPublicIP>:setup Error 6.25 test_network.py
test_reboot_router Failure 0.05 test_network.py
test_releaseIP Error 3.33 test_network.py
test_releaseIP_using_IP Error 3.24 test_network.py
ContextSuite context=TestRouterRules>:setup Error 3.30 test_network.py
test_01_deployVMInSharedNetwork Failure 1204.41 test_network.py
test_02_verifyRouterIpAfterNetworkRestart Failure 603.79 test_network.py
ContextSuite context=TestSharedNetworkWithConfigDrive>:setup Error 1514.46 test_network.py
test_01_nic Error 1557.72 test_nic.py
ContextSuite context=TestNonStrictAffinityGroups>:setup Error 0.00 test_nonstrict_affinity_group.py
test_01_isolated_persistent_network Error 603.07 test_persistent_network.py
test_03_deploy_and_destroy_VM_and_verify_network_resources_persist Error 0.03 test_persistent_network.py
ContextSuite context=TestL2PersistentNetworks>:teardown Error 0.07 test_persistent_network.py
ContextSuite context=TestPortForwardingRules>:setup Error 0.00 test_portforwardingrules.py
test_01_add_primary_storage_disabled_host Error 0.23 test_primary_storage.py
test_01_primary_storage_iscsi Error 306.80 test_primary_storage.py
test_01_primary_storage_nfs Error 0.22 test_primary_storage.py
ContextSuite context=TestStorageTags>:setup Error 0.41 test_primary_storage.py
ContextSuite context=TestPrivateGwACL>:setup Error 0.00 test_privategw_acl.py
test_09_project_suspend Error 1.07 test_projects.py
test_10_project_activation Error 1.05 test_projects.py
ContextSuite context=TestPurgeExpungedVms>:setup Error 0.00 test_purge_expunged_vms.py
test_another_user_can_allocate_ip_after_quarantined_has_ended_network Error 4.18 test_quarantined_ips.py
test_another_user_can_allocate_ip_after_quarantined_has_ended_vpc Error 0.27 test_quarantined_ips.py
test_only_owner_can_allocate_ip_in_quarantine_network Error 0.25 test_quarantined_ips.py
test_only_owner_can_allocate_ip_in_quarantine_vpc Error 0.28 test_quarantined_ips.py
test_deploy_vm_with_registered_userdata Error 5.27 test_register_userdata.py
test_deploy_vm_with_registered_userdata_with_override_policy_allow Error 5.21 test_register_userdata.py
test_deploy_vm_with_registered_userdata_with_override_policy_append Error 5.41 test_register_userdata.py
test_deploy_vm_with_registered_userdata_with_override_policy_deny Error 5.25 test_register_userdata.py
test_deploy_vm_with_registered_userdata_with_params Error 5.39 test_register_userdata.py
test_link_and_unlink_userdata_to_template Error 5.31 test_register_userdata.py
test_user_userdata_crud Error 5.35 test_register_userdata.py
ContextSuite context=TestResetVmOnReboot>:setup Error 0.00 test_reset_vm_on_reboot.py
test_02_create_template_with_checksum_sha1 Error 65.50 test_templates.py
test_03_create_template_with_checksum_sha256 Error 65.43 test_templates.py
test_04_create_template_with_checksum_md5 Error 65.46 test_templates.py
test_05_create_template_with_no_checksum Error 65.45 test_templates.py
ContextSuite context=TestTemplates>:setup Error 7.39 test_templates.py
ContextSuite context=TestRAMCPUResourceAccounting>:setup Error 0.00 test_resource_accounting.py
ContextSuite context=TestResourceNames>:setup Error 0.00 test_resource_names.py
ContextSuite context=TestRestoreVM>:setup Error 0.00 test_restore_vm.py
ContextSuite context=TestRouterDHCPHosts>:setup Error 0.00 test_router_dhcphosts.py
ContextSuite context=TestRouterDHCPOpts>:setup Error 0.00 test_router_dhcphosts.py
ContextSuite context=TestISOUsage>:setup Error 0.00 test_usage.py
ContextSuite context=TestLBRuleUsage>:setup Error 0.00 test_usage.py
ContextSuite context=TestNatRuleUsage>:setup Error 0.00 test_usage.py
ContextSuite context=TestPublicIPUsage>:setup Error 0.00 test_usage.py
ContextSuite context=TestSnapshotUsage>:setup Error 0.00 test_usage.py
ContextSuite context=TestVmUsage>:setup Error 0.00 test_usage.py
ContextSuite context=TestVolumeUsage>:setup Error 0.00 test_usage.py
ContextSuite context=TestVpnUsage>:setup Error 0.00 test_usage.py
ContextSuite context=TestRouterDns>:setup Error 0.00 test_router_dns.py
test_1_userdata_on_ssvm Failure 0.09 test_systemvm_userdata.py
test_2_userdata_on_cpvm Failure 0.08 test_systemvm_userdata.py
test_3_userdata_on_vr Error 5.41 test_systemvm_userdata.py
ContextSuite context=TestRouterDnsService>:setup Error 0.00 test_router_dnsservice.py
test_01_import_storage_policies Error 0.00 test_storage_policy.py
ContextSuite context=TestRouterIpTablesPolicies>:setup Error 0.00 test_routers_iptables_default_policy.py
ContextSuite context=TestVPCIpTablesPolicies>:setup Error 0.00 test_routers_iptables_default_policy.py
test_01_isolate_network_FW_PF_default_routes_egress_true Error 0.15 test_routers_network_ops.py
test_02_isolate_network_FW_PF_default_routes_egress_false Error 0.14 test_routers_network_ops.py
ContextSuite context=TestRedundantIsolateNetworks>:setup Error 1.28 test_routers_network_ops.py
ContextSuite context=TestRouterServices>:setup Error 0.00 test_routers.py
ContextSuite context=TestScaleVm>:setup Error 0.00 test_scale_vm.py
ContextSuite context=TestServiceOfferings>:setup Error 0.21 test_service_offerings.py
ContextSuite context=TestSetSourceNatIp>:setup Error 0.00 test_set_sourcenat.py
ContextSuite context=TestSnapshotRootDisk>:setup Error 0.00 test_snapshots.py
ContextSuite context=TestSnapshotStandaloneBackup>:setup Error 0.00 test_snapshots.py
ContextSuite context=TestVmAutoScaling>:setup Error 0.00 test_vm_autoscaling.py
ContextSuite context=TestSslOffloading>:setup Error 0.00 test_ssl_offloading.py
test_01_list_sec_storage_vm Failure 0.03 test_ssvm.py
test_02_list_cpvm_vm Failure 0.02 test_ssvm.py
test_03_ssvm_internals Failure 0.03 test_ssvm.py
test_04_cpvm_internals Failure 0.03 test_ssvm.py
test_05_stop_ssvm Failure 0.03 test_ssvm.py
test_06_stop_cpvm Failure 0.03 test_ssvm.py
test_07_reboot_ssvm Failure 0.03 test_ssvm.py
test_08_reboot_cpvm Failure 0.03 test_ssvm.py
test_09_reboot_ssvm_forced Failure 0.03 test_ssvm.py
test_10_reboot_cpvm_forced Failure 0.03 test_ssvm.py
test_11_destroy_ssvm Failure 0.03 test_ssvm.py
test_12_destroy_cpvm Error 1.12 test_ssvm.py
test_01_deploy_vm_on_specific_host Error 0.07 test_vm_deployment_planner.py
test_02_deploy_vm_on_specific_cluster Error 1.22 test_vm_deployment_planner.py
test_03_deploy_vm_on_specific_pod Error 1.27 test_vm_deployment_planner.py
test_04_deploy_vm_on_host_override_pod_and_cluster Error 0.10 test_vm_deployment_planner.py
test_05_deploy_vm_on_cluster_override_pod Error 1.26 test_vm_deployment_planner.py
ContextSuite context=TestDeployVM>:setup Error 0.00 test_vm_life_cycle.py
ContextSuite context=TestVMLifeCycle>:setup Error 4.59 test_vm_life_cycle.py
ContextSuite context=TestVMSchedule>:setup Error 0.00 test_vm_schedule.py
test_change_service_offering_for_vm_with_snapshots Error 1.43 test_vm_snapshots.py
ContextSuite context=TestVmSnapshot>:setup Error 13.74 test_vm_snapshots.py
ContextSuite context=TestMigrateVMStrictTags>:setup Error 0.00 test_vm_strict_host_tags.py
ContextSuite context=TestRestoreVMStrictTags>:setup Error 0.00 test_vm_strict_host_tags.py
ContextSuite context=TestScaleVMStrictTags>:setup Error 0.00 test_vm_strict_host_tags.py
ContextSuite context=TestVMDeploymentPlannerStrictTags>:setup Error 0.00 test_vm_strict_host_tags.py
test_01_register_vnf_template Error 0.06 test_vnf_templates.py
test_02_list_vnf_template Error 0.04 test_vnf_templates.py
test_03_edit_vnf_template Error 0.04 test_vnf_templates.py
test_04_deploy_vnf_appliance Error 0.05 test_vnf_templates.py
test_05_delete_vnf_template Error 0.05 test_vnf_templates.py
ContextSuite context=TestCreateVolume>:setup Error 0.00 test_volumes.py
ContextSuite context=TestVolumes>:setup Error 4.44 test_volumes.py
test_01_verify_ipv6_vpc Error 7.37 test_vpc_ipv6.py
ContextSuite context=TestVPCRedundancy>:setup Error 0.00 test_vpc_redundant.py
ContextSuite context=TestVPCNics>:setup Error 0.00 test_vpc_router_nics.py
ContextSuite context=TestRVPCSite2SiteVpn>:setup Error 0.00 test_vpc_vpn.py
ContextSuite context=TestVPCSite2SiteVPNMultipleOptions>:setup Error 0.00 test_vpc_vpn.py
ContextSuite context=TestVpcRemoteAccessVpn>:setup Error 0.00 test_vpc_vpn.py
ContextSuite context=TestVpcSite2SiteVpn>:setup Error 0.00 test_vpc_vpn.py

@vishesh92 vishesh92 mentioned this pull request Mar 13, 2026
14 tasks
@sureshanaparti sureshanaparti merged commit 3b42fbf into apache:4.22 Mar 13, 2026
25 of 26 checks passed
@sureshanaparti sureshanaparti deleted the fix-ci-failures branch March 13, 2026 08:04
@sureshanaparti sureshanaparti moved this from In Progress to Done in Apache CloudStack 4.22.1 Mar 13, 2026
@blueorangutan
Copy link

[SF] Trillian test result (tid-15646)
Environment: xcpng83 (x2), zone: Advanced Networking with Mgmt server ol9
Total time taken: 54842 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr12789-t15646-xcpng83.zip
Smoke tests completed. 128 look OK, 7 have errors, 14 did not run
Only failed and skipped tests results shown below:

Test Result Time (s) Test File
test_01_events_resource Error 189.51 test_events_resource.py
test_list_system_vms_metrics_history Failure 0.19 test_metrics_api.py
test_list_vms_metrics_history Failure 154.69 test_metrics_api.py
test_01_non_strict_host_anti_affinity Error 156.08 test_nonstrict_affinity_group.py
test_02_non_strict_host_affinity Error 52.64 test_nonstrict_affinity_group.py
test_02_list_snapshots_with_removed_data_store Error 13.73 test_snapshots.py
test_02_list_snapshots_with_removed_data_store Error 13.73 test_snapshots.py
test_01_vpn_usage Error 1.14 test_usage.py
test_01_scale_up_verify Failure 506.50 test_vm_autoscaling.py
test_02_update_vmprofile_and_vmgroup Failure 260.22 test_vm_autoscaling.py
test_06_autoscaling_vmgroup_on_project_network Failure 405.62 test_vm_autoscaling.py
test_06_autoscaling_vmgroup_on_project_network Error 405.63 test_vm_autoscaling.py
test_07_autoscaling_vmgroup_on_vpc_network Failure 435.00 test_vm_autoscaling.py
test_07_autoscaling_vmgroup_on_vpc_network Error 435.01 test_vm_autoscaling.py
ContextSuite context=TestVmAutoScaling>:teardown Error 488.18 test_vm_autoscaling.py
test_11_destroy_vm_and_volumes Error 28.33 test_vm_life_cycle.py
all_test_vm_schedule Skipped --- test_vm_schedule.py
all_test_vm_snapshot_kvm Skipped --- test_vm_snapshot_kvm.py
all_test_vm_snapshots Skipped --- test_vm_snapshots.py
all_test_vm_strict_host_tags Skipped --- test_vm_strict_host_tags.py
all_test_vnf_templates Skipped --- test_vnf_templates.py
all_test_volumes Skipped --- test_volumes.py
all_test_vpc_ipv6 Skipped --- test_vpc_ipv6.py
all_test_vpc_redundant Skipped --- test_vpc_redundant.py
all_test_vpc_router_nics Skipped --- test_vpc_router_nics.py
all_test_vpc_vpn Skipped --- test_vpc_vpn.py
all_test_webhook_delivery Skipped --- test_webhook_delivery.py
all_test_webhook_lifecycle Skipped --- test_webhook_lifecycle.py
all_test_host_maintenance Skipped --- test_host_maintenance.py
all_test_hostha_kvm Skipped --- test_hostha_kvm.py

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

Status: Done

Development

Successfully merging this pull request may close these issues.

5 participants